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Assuming the perception of similarities .as a fundamental psychological 
the applicability of a multidimensional scaling, nonmetric technique called MAPK 
CMath^atical Analysis of Perception and Preference) is demonstrated using three 
case studies. Any technique which provides paired similarity ranks can be used to 
collect data necessary for MAPP input. From the set of similarity ranks and 
preference rank. MAPP determines: Cl) the subject's perception of what is relevant in 
the stimulus, (2) clusters of perceived objects in terms of the attributes considerea 
(3) clusters of respondents, and (4) different perceived ideals and clusters of people 
sharing each Ideal. In the first case study, hypotheses of perceptual congruwcy were 
tested, with four perceptual styles differentiating among Elementary and Secondary 
Education Act Title III administrators. The results of the second case study suggest 
that, in an occupational hierarchy, “agressive noncompliance’* is more characteristic of 
top^rung members, and compliance to institutional norms upon request Is more 
characteristic of lower rung members. Data analysis for the third study Is not 
complete. Since MAPP does not require verbal or introspective responses, and 
attempts to elicit how respondents feel about stimuli In relation to each other, 
affective measurement implications become apparent. (PS) 
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o£ the attribute space and the strong assumptions underlying input 
data when one desires interval or ratio scales* Oppenheim and others 
previously described these assumptions and/or limitations and 



of subject response* Among the purposes of an unreported feasi- 
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bility study, later amplified in a dissertation, was one of demo** 

strating the applicability of a multidimensional scaling, nonmetric 
technique developed in market research to educational research* 

Called M^P (Mathematical Analysis of Perception and Preference), 
this technique is also presently being used in a state-wide educa- 
tional-needs assessment in Pennsylvania under ESEA Title III* In 
the latter, the non-verbal potential of the technique is also being 
demonstrated through the use of photographs as stimuli* 
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What is MAPP7 A Brief Review for the Lavman or the Uninitiated 
"Our own experiences, common sense, and psychological research 
to tell us that no two people see the world exactly the same way* Rather 
? our varying biological, cultural, social, and personal histories lead 
us to pay attention to different aspects of our environment and to 
evaluate in our own way what we perceive* Meaning, as well as beauty. 
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Getzels proposed another — the assumption underlying authenticity 
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la In the eye of the beholder* 

Sonetinea these differences of perception and evaluation can 
be troublesome* As people become more Interdependent ^ these dif- 
ferences can cause poor communication^ friction^ distrust « and 
occasionally social breakdown* In Intimate family relationships^ 
International diplomacy^ education^ race relationships » organiza- 
tional decision making ^ and many other areas ^ these largely unrec- 
ognized private world views Interfere with our ability and hmnper 
our desire to behave productively In a complex society* 

"There have been many attempts to »get Inside someone else*s 
head* and see the world as he sees It* These attempts range from 
psychoanalytic studies to projective tests like the Rorschach (and) 
to asking people directly idiat they think » as In political polls* 
The techniques ^e based « In part, on the respondent's ability to 
Introspect and to be articulate about the results of that Introspec- 
tion* Many of these approaches work quite well, many are poorly or 
Inappropriately used* The MAPP system represents a recent addition 
to the methods available for attacking this Important and difficult 



MAPP (Mathematical Analysis of Perception and Preference) grew 
out of psychometrics* It xs based on the xdea that the perception 
of similarities Is a fundamental psychological process* If I know 
that you think Charles Dickens a lot like Herman Melville, but that 
Henry James Is very different from each of them, I know something of 



your view of 19th century novelists* If I pick, say, nine or ten 
novelists and have you rank them in terms of similarities to each 
other and then get you to rank them from best to worst (or most 
preferred to least preferred), I have all the data I need for a 



problem* 
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t 3 rplcal MAPP analysis. There are many ways to collect the data 
necessary for MAPP input* Any technique (rating or ranking) that 
provides paired similarity ranks can be used* The one most often 
used requires the respondent to take a stimulus as the 'standard,* 
and then pick one of the other stimuli as most similar the 
criteria of similarity are left entirely up to the respondent* The 
respondent then picks from the remaining stimuli the one most sim- 
ilar to the standard, and so on, until all the stimuli have been 
ranked in order of their similarity to the standard* Then another 
stimulus is selected as the standard and the other stimuli are ranked 
against itf and so on until each stimulus has served as a standard 
or 'anchor point*' Then the items are ranked once as to preference* 
This method usually takes about a half an hour and has often been 
used with groups of respondents* The data collection costs are 
usually much less than tsrpical interviewing methods* MAPP takes 
as input this set of similarity ranks and preference rank and deter- 
mines from them: 

1* The number of attributes used by the respondent 
to rank the similarities; that is, what he 
perceives as relevant in the stimulus* 

2* Any clusters of perceived objects (in this illus- 
tratlon, 19th century novelists)* That is, how 
the stimuli cluster together in terms of the at- 
tributes considered* 

3* Any clusters of respondents * How many ways of 
seeing neve lists are there and how many people 
see them each way? 

4* What are the characteristics of an Ideal novelist? 

How many different ideals are there and how many 
people share each ideal? 

"These questions are answered without asking the respondent 
any clarifying questions, or indeed, any questions at all* These 
questions are answered solely from analysis of the rank order com- 
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parison of the stimuli* Without going into any of the mathematical 
9, 10, 11 

details, this analysis makes use of the excess information 

contained in the ranking of every stimulus with every other one*" 
Three MAPP Case Studies — Procedures 

From more than 200 ESEA Title III funded projects in four 
participating states (New Jersey, New York, Delaware and Pennsyl- 
vania), an abstract-of -project stimuli-array of diverse educational 
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activities was selected for the initial feasibility study* With 
geographic and other Identifications removed, the array was presen- 
ted to ESEA Title III staff in four state education departments 
(N = 40) and in the U* S* Office of Education (N « 10) to test 
several hypotheses concerning congruency of perceptions and pre- 
ferences relating to ESEA Title III intents* Using these responses 
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as pre-data, a dissertation study provided institutional-goal 
"treatment" and gathered post -data using the same stimuli and 28 
of the same respondents (total post-data N s 36) to test partici- 
pant ability to demonstrate institutional -goal behavior on request* 
After post-testing, USOE staff in two separate jury- judging sessions 
provided similar "ideal MAPPs," against which all pre- and post- 
MAPPs were compared* The third application of MAPP, a need-assessment 

study now nearing Phase I completion, used 5x7 glossy photographs 
14 

as stimuli tf The photographs depicted various growing-up, formal 

and informal educational activities, process and product oriented, to 

\ 

which various audiences (N = 3000) in Pennsylvania responded* The 
audiences included fifth and eleventh grade children, parents, teach- 
ers, administrators and community influentials in a stratified sample* 
Results 

The first two studies are completed* Both successfully demon- 
strated the efficacy of MAPP as a technique to describe perceptual/ 
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preferential profiles relating to educational problems* The third 
study y originally sheduled for completion circa December 31 y 1968 y 
was delayed approximately six weeks due to data collection problems* 
Data is now being analyzed and a study report will be available on 
or before March 31 y 1969* 



Case Study #1 
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Feasibility«study data was analyzed with TRICON y TORSCAy and 



the Howard-Harris Clustering Routine y the latter using Euclidean 
distance as proximity measures* TRICON y a Coombsian method to triang- 



ularlze conjoint datay provided the proximity measures whichy in this 



casey consisted of 28 paired-stimuli similarity measures for the eight 
stimuli used* The Howard -Harris 



grouping principal is hierarchical and (is) based on the 
attainment at each stage of minimal with in-cluster variance y 
summed over all clusters ** *The objects are first split into 
two groups according to the single characteristic displaying 
the largest variance* Objects are then shifted from cluster 
to cluster until the minimum varioice criterion is satisfied* 
The cluster containing the larger variance is next split into 
two clusters and objects are again distributed over clusters 
in accordance with the minimum variance criterion* 17 

Four clusters, judged as optimum (Howard-Harris could provide up 

to 20) from the 47 useable sets of subject responses* Each cluster 

contained subjects whose perceptual style their way of ** seeing” 



the stimuli — was more like each other's style in the common clus- 
ter than subject styles in the other three clusters* Tables ly 2y 
and 3 illustrate the distribution of styles* 



Table 1* Distribution of Subjects by Perceptual Style 

Number of 



Style Subjects Percent 



1 


• 


9 


m 


2 




13 


28% 


3 




6 


13% 


4 




19 


40% 




Total 


47 


100% 
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Table 2. Distribution Among Perceptual Styles by State 





Percent 




Actual Percent 






Style 


It 


Pa 

N s 16 


SI 

N. « 8 


N s 4 


Del 
N » 8 


Ss. 

N a 1 


OE 

N » 10 


1 


19% 


12.5% 


12.5% 


25.0% 


12.5% 


0 % 


40% 


2 


28 


25.0 


25.0 


0 


62.5 


0 


20 


3 


13 


12.5 


12.5 


25.0 


25.0 


0 


0 


4 


40 


50.0 


50.0 


50.0 


0 


100 


40 




100% 


100% 


100% . 


100% 


100% 


100% 


100% 






Table 3- Distribution of Perceptual Styles by ^.dminiatrativa Levels 
““ (excluding all Delaware subjects) 




Table 3 does not include the Delaware 2 «bjeet 8 
^»ed to be acting quite differently fr^ JS* 

Delaware were included, then Table 3 would be aa followe. 




st\ 


rle 


All Subiects 


OE Mamt 


OE Area 


state Mgmt 


state Staff 


Local 


N 


% 


N a 3 


N g 7 


N a 8 


N «18 


N « 11 


1 




9 


19% 


100% 


14% 


12.5% 


11.1% 


18% 


2 




13 


28 


- 


29 


12.5 


50.0 


9 


3 




6 


13 


- 


- 


37.5 


5.5 


18 


4 




19 


40 


- 


57 


37.5 


33.3 


55 




47 

* 


100% 


100% 


100% 


100% 


:99.9% 


100% 
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Case Study #2 

Unlike the feasibility study datSy the analysis of which focused 

on **style" and not on responses (i«e«y how the subjects responded, not 

what their responses were), the ensuing dissertation study analysed 

response frequences of the singl^i-sort preferential vector. Addl- 

18 

tlonally and moving away from the responses per se, the second 

study also used Spearman rank-difference correlation coefficients 

to test the degree of association among subjects* multiple-sort 

perceptual configurations and between a single subject* s configuration 

and the U80E Jury- Judged **ideal** institutional -goal oriented conflg- 

19 

uratlon. Using the Carroll-Chang program, this study further tested 
for **goodness of fit'* between a subject's preferential vector and 
his perceptual configuration as provided in a (TORSCA) simple- 
space analysis of the multidimensional scaling. Tte mean correlation 
(goodness-of-fit statistic) for 25 subjects in pre-MAPPing was .97; 
for the same 25 subjects in post-MAPPlng it was .955. 

In addition to providing similarity measures and serving as a 
preprocessing program for simple-space analysis, TRICON also furn- 
ishes an index of subject inconsistency in repetitive perceptual 
sorts. Called Intransitlvlties, they (along with "stress** indices 
generated in TORSCA simple-space analysis when multidimensional 
scaling is reduced to two dimensions) were used in the second study 
as indicators of cognitive dissonance. Up to ten per cent sort 
Inconsistency and up to ten per cent two-dimensional stress were 
arbitrarily selected as acceptable indicators of normal cognitive 
dissonance when dealing with the eight stimuli used. Table 4 
‘ depicts pre- (feasibility-study data) and post-preferential fre- 
quency percentages of responses to four stimuli (1,4, 5, 8) containing 
national-priority cues (i.e.. Institutional goals). 



table 4 



- 

PERCENTAGE OP PRE-/POST -PLACEMENT OP NATIONAL PRIORITY 
STIMULI IN PIRST POUR PREPERENCES, BY STIMULI 
NUMBER AND ACROSS GROUPS 



Pre- 


USOE 


USOE 


State 


state 


State 


State 


Place- 


Nat'l 


Ad'^in. 


Prog. 


Coord. 


Middle 


Newer 


Reg*l 


ment 


Prior. 


(H=5) 


(N=5) 


(N=6) 


Hgm't 


Staff 


Staff 


Average 


Stimuli 






e 


(N=10) 


(N=5) 


(N=12) 


(»=43) 


1 


100 


80 


100 


70 


100 


58.3 


79.1 


k 


kO 


80 


83.3 




100 


91.7 




5 


8o 


80 


100 


8o 


100 


91.7 


88.4 


8 


40 


60 


83.3 


70 


80 


58.3 


65.1 


Total 


65 


75 


91.6 


65 


95 


75 


76.2 


Post 


USOE 


USOE 


State 




state 


state 


Place- 


Nat .* 1 


Admin. 


Prog. 


Coord. 


Middle 


Newer 


Reg<l 


ment 


Prior . 


(H=6) 


(N=6) 


(H=4) 


Mgm't 


Staff 


Staff 


Average 


Stimuli 








(M=4) 


(N=4) 


(M-12) 


(N-3^ 


1 


66.6 


100 


100 


100 


. 100 


91.7 


91.7 




100 


83.3 


100 


75 


50 


91.7 


86.1 


5 


100 


100 


75 


100 


100 


100 


100 


8 


33.3 


100 


100 


100 


100 


75 


77.7 


Total 


75 


95.8 


93.7 


93.7 


87.5 


89.6 


88.9 


Pre/ 
















Post 
















Gain 


10 


20.8 


2.1 


28.7 


7.5 


14.6 


12.7 



^et Loss 



Tabl« 5 daplcta participating aubgroup corralationa for idiosyn- 
cratic (pra-teat) and inatitutional-goal oriented (poat-teat) per- 
ceptual reaponaea. 
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Table 6 illustrate s subgroup movement 9 pre to post 9 toward the 
jury- judged Inatitutional-goal perceptual ♦•ideal 



Table 6 



PERCENTAGE OP GROUP MOVEMENT^ TOWARD (AWAY PROM) 
JURY "IDEAL” PERCEPTUAL SEQUENCES^ 



Movement 
Toward 
(Away Prom) 


USOE 


USOE 




State 




Average 


Admin. 

Staff 


Prog. 

Staff 


Coord. 


Middle. 

Mg't. 


Newer 

Staff 


Reg*l 

Staff 


Movem* t 
For All 
Groups 


OE Program 
Jury (N=28) 


(214..9) 




0 


26 .lt. 


10.lt 


52.7 


17.6 


OE Program 
Jury (N=36) 


17.3 




0 


26 .lt 


10.lt 


56.0 


16.3 



^ As determined from comparison of pre-group and pre- 
total means (N=28) with post means (N=38)> using the 
formula : 

smaller. 



Per cent Movement = 100 



f- 



larger 



-J 



Should the numerator bo a pre-r, movement is toward 
the jury ideal sequences* Should it bo a post-r 
mean, movement is away (percentage enclosed in paren- 
theses) from the "ideals.” 



Ninth and only sort of the PACE abstract stimuli for 
preference -— from most to least preferred. The 
first -‘Oi^t sorts are perceptual. 




7sbla 7 suggests the amount of cognitive -dissonance reduction that 
took place9 pre to post 9 when all post-test subjects (including USOE 
participants) were asked to role-play Washington 9 D* C* ••official 
ESEA Title III norms^^ (institutional goals) 9 i* e* to simulate USOE 
thinking re: the ESEA Title III abstract array. (The acceptable 
ten per cent intransitivities limit is equal to 17 intransitivities.) 
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Table 7 

COMPARISOH OF PRE-/FOST-INTRANSITIVlT2r HBAHS (ntlCOH) 

AND STRESS MEANS (TORSGA) 





Pre-Te3F'{Syi.7) " 


Fosi-Test 


iN=36j_ 


Participant 

Groups 


Mean 
Number 
In transi- 
tivities 


Mean 
Per Cent 
Stress 


Mean 
Number 
In transi- 
tivities 


Mean 
Per Cent 
Stress 


USOE Admin. 


21 .ii. 


10.6 


19.6 

a 


11.3 


USOE Program 


23.6 ^ 


12.6 


16.5 


12.1 


OE Total , 


22.5 


11.7 


18.1 


11.6 


State Coor- 
dinators 


H1..9 


8.7 


8.8 


8.0 


Middle M^*t* 


18.7 


11.0 


23.0 


11.5 


Newer Staff 


15.3 


10.6 


10.5 


5.7 


State Total 


16.7 


10.2 


Uf.l 


0.4 


State Regional 21.2 


11.5 


15.2 


9.3 


Mean of All 
Groups 


21.2 


10.9 


15.8 


9.7 
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Case Study #3 

Data analysis in this significantly larger study (N « 3000) 9 
although not yet complete 9 will be more discriminating and use more 
MAPP subroutines (there are 50^ routines in the MAPP package 9 present- 
ly) than did the previous two studies* Clustering analysis of the 
eight sets of eight photographs (32 process-oriented 9 32 product- 
oriented 9 all of which were selected using an extensive array of 
criteria — racially mixed groups 9 non-mixed children9 formal and 
informal activities 9 in-school and out-of -school 9 etc*) will use 
correlation coefficients instead of proximity measures as in H-^* 



Interpretation 



In the feasibility study (Case Study #1) idierein hypotheses of 
perceptual congruency were tested ^ four different perceptual styles 
distinguishing ESEA Title III administrators appeared* 

The Prostram Transmission System 
Office of Education top management shared one perceptual 
ntyle y the state top management tended to share a second perceptual 
style; a third perceptual style tended to be that of those neo to 
Title III management; and the fourth and dominant style was that 
of the program implementors* This last style included personnel at 
all administrative levels (except OE top management) from OE Area 
Desk (staff) to local project directors* 

Program Consistency 

**To the extent that one can consider consistency as a test of 
success y one can point to a unified approach by OE top management 
as a successful, coherent translation of Congressional intent of 
Title III purpose* 

'*This perspective is transmitted directly all the way down the 
line, from top management to Area Desk to State Management to Local 
Project Directors* In a narrow sense, therefore, one might say that 
the second test of OE management has been met: the ability to trans- 

mit its policy directly down the line* 

**However, the existence of a state management style and a strong 
program implementor's style suggests that policy coherence is being 
transmitted through a chain with three distinct, though related strands 
federal management; state management; and implementors* 

Creativity Down the Line 

*Mhat do these findings have to say about the problem of bal- 
ancing policy coherence with creativity? We enter here into the grey 



« • 
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area of Judgement* It £a simple to identify a situation where 
management policies are being followed with simple-minded non- 
creativity: all the subjects would view all the projects in the 

same way as did top management* We do not have such a situation 
here* In the same wayt it is simple to identify a situation where 
individual creativity has run away with the program: there would 

be no significant representation of the management view at other 
administrative levels* This 9 too, is not true of the Title III 
program* 

**What is a *good* distribution of management and program per- 
spectives? This study cannot speak to that question 9 which is large- 
ly one of Judgement 9 policy 9 and taste* All this study can demon- 
strate is that the administrators involved in the Title III program 

do not fall into the extremes either of docile overcompliance or 

20 

aggressive noncompliance *** 

Additional evidence gathered for Case Study tfl suggests that9 
in terms of occupational hierarchy 9'*aggres8ive noncompliance** may 
be more characteristic of the top-rung members and compliance to ' 
institutional norms upon request may be more characteristic of 
lower -rung members* The following figure illustrates study # 2 *s 
hsnpotheses eoAcerning occupational hierarchy and study-results: 




Xhrcc possible explaxistions for the reverssl of the hypo- 
thesised occupetionel hierarchy outcomes are suggested: 

•♦1. In terms of in-group/out-group concepts in s mail-group 
theory t the higher occupational levels (the in-group) felt less 
compelled to conform to institutional-goal requirements; the 
lower groups felt more compelled to conform. 

”2. In terms of power allocation concept s, the "vested 
power** levels similary felt less . compelled to conform in order 
to accrue a greater share of power than did the lower , power- 
periphery levels who wish> (generally) to increase their share 
of power. 

"3. In terms of discretionary authority » the 0£ levels in 
the PACE (ESBA Title III) state-federal hierarchies had (and 
continue to have 9 despite legally mandated state transfer of 
PACE authority) the larger share of discretionary authority. The 
OE levels continued to display this occupationally natural auth- 
ority even in this relatively minor PACE study. That such 
discretionary authority exists in OB has been documented. ..and 

biases (the investigator) toward it rather than the first two 

21 

explanations suggested.** 

Conclusion 

**M<IPP (Mathematical Analysis of Perception and Preference) 

has clearly proved to be a useful and relevant technique. It is 

acceptable as a data collection device and the insights derived 

22 

from the data are provocative and useful.** The yet-uncompleted 
but more sophisticated discriminant analysis now underway for 
Case Study #3 tends to strengthen this conclusion. Since MAPP does 
not require verbal or introspective response and, in essence 9 attempts 
to elicit how respoudees *'feel** about stimuli in relation to each 
other 9 affective measurement implications are obvious. 
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